; Autonomous Intee;ral Functionals with Discontinuous 

o ° 



o 

(N 



(N 

< 



Nonconvex Integrands: Lipschitz Regularity of Minimizers, 
DuBois-Reymond Necessary Conditions, 
and Hamilton-Jacobi Equations 

Gianni Dal Maso* and Helene Frankowska^ 



Abstract 



This paper is devoted to the autonomous Lagrange problem of the calculus of vari- 
ations with a discontinuous Lagrangian. We prove that every minimizer is Lipschitz 
continuous if the Lagrangian is coercive and locally bounded. The main difference 
^ ■ with respect to the previous works in the literature is that we do not assume that 

, the Lagrangian is convex in the velocity. We also show that, under some additional 

CO ■ assumptions, the DuBois-Reymond necessary condition still holds in the discontinuous 

i case. Finally, we apply these results to deduce that the value function of the Bolza 

' problem is locally Lipschitz and satisfies (in a generalized sense) a Hamilton-Jacobi 

, equation. 

o 

■ Key words. Discontinuous Lagrangians, nonconvex integrands, Lipschitz minimizers, DuBois- 

^ ' Reymond necessary conditions, Hamilton-Jacobi equations. 

AMS Mathematics Subject Classification 2000: 49N60 (primary), 49K05, 49L25 (sec- 
. ondary). 



'SISSA, via Beirut 2-4, 34014 Trieste, Italy 

e-mail: dalmaso@sissa.it 
t CNRS, CREA, Ecole Poly technique, 1, Rue Descartes, 75005 Paris, France 

e-mail: f rankoSpoly . polytechnique . f r 



1 



1 Introduction 



In this paper we study the Lipschitz continuity of the solutions to the Lagrange problem 
of the calculus of variations 

(1.1) mm y\{y{t),y'{t))dt\y£W^'\a,b;R''), y{a) = Xa, y(6) = x^j , 

where the Lagrangian L : 1?" x 1?" — > is a Borel function having a superlinear growth 
with respect to the second variable, i.e., there exists a function 6:1?" — > 1?+, with 

(1.2) lim -p/ = +00, 

ImI— >oo \u\ 

such that 

(1.3) y {x,u) e X R", L{x,u)>e{u). 

We assume also that L is bounded in a neighborhood of each point of J?" x {0}, i.e., 

(1.4) V xo G li", 3 M > 0, 3 r > 0, V (x, u) G B{xo, r) x B{0, r), L{x, u) < M, 

where B{xo,r) is the closed ball with center xq and radius r. 

The existence of a solution to ( |1.1| ) is an easy consequence of the direct method of the 
calculus of variations when the functional 

(1.5) Ciiy):= [\{y{t),y'{t))dt 

is sequentially weakly lower semicontinuous on W^'^{a,b; R). 



By the classical results of Olech |15] and loffe |13[], a standard assumption for the 
semicontinuity of is that L is lower semicontinuous on 1?" x and L{x,-) is convex 
on l?" for every x G -R", but these conditions are not necessary for the lower semicontinuity 
oiCl (see, e.g., H). 

Recently Amar, Bellettini and Venturini have proved in [|l| that any integral func- 
tional of the form (L5), satisfying suitable growth conditions, has a lower semicontinuous 
envelope C\ that can be written as 

(1.6) Ci{y)= [\+iy{t),y'it))dt, 



where is an integrand depending on L (see ( [4. 4] )). If L is continuous, then coincides 
with the convexification Lq of L with respect to u, but, if L is discontinuous, one can prove 
only that the function L^{x, ■) is convex for a.e. x G 1?", and there are examples where 
L'^{-,u) is not lower semicontinuous on K". 
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This shows that there are problems of the form (^]^) which admit a solution even if 
L is not convex in u (nor lower semicontinuous in x), and provides a motivation for the 
study of the Lipschitz continuity of the solutions of ( |1.1| ) without convexity hypotheses. 

If •) is convex for every x G 12", it was proved by Ambrosio, Ascenzi, and Buttazzo 
m II that every minimizer of ( |1.1| ) is Lipschitz continuous. This kind of results goes back 
to Tonelli [17, 18 1 for smooth Lagrangians, and is the first step to prove, under some 
additional conditions on L, that all minimizers are smooth (see, e.g., [^, Section 2.6]). 
Note that, in general, when the Lagrangian is time dependent, the problem may have no 
Lipschitz minimizer (see Q and [p!o|]). 

The aim of Section |2| of the present paper is to show that the convexity hypothesis can 



be removed from y]. Assuming only (L2), ([L.3|), and (1_^), we prove that all minimizers of 
( |1.1D are still Lipschitz continuous (Theorem |2.1| ) , and provide an estimate of the Lipschitz 
constant if, in addition, L is locally bounded (Theorem |2.2D . 

If L is continuous, then every minimizer y of ( |1.1[ ) is also a minimizer of the same 
problem with L replaced by its convexification Lq with respect to n, so that the Lipschitz 
continuity of y follows from Q. But, if L is discontinuous, we can only say (under suitable 
growth conditions) that y is a minimizer of ( |l.lD with L replaced by L+, and we know that 
L^(x, •) is convex only for a.e. x G -R". For this reason we can not apply the results of 
[0. On the other hand, the proof of [Q] is based on an extension of the DuBois-Reymond 
necessary condition, which is not always valid when -L(x, •) is not convex. Therefore we 
need different arguments. 

As in , we begin by proving (Lemma |2.3| ) that if y is a minimizer of ( |l . l]) , then the 
function ilj{t) := t is a minimizer of the problem 



mm 



where 

(1.7) f{t,v 



r L{y{t),y'{t)/v)v if v > \, 
[ +00 if f < ^. 

Then we show (Lemma ^^ ) that ilj{t) := t \s a. minimizer of the problem 

Ut,ij'{t))dt\ij(^W^'\a,h), ^(a) = a, V(&) = fej , 
where /o = cOt,/ is the lower semicontinuous convex envelope of / with respect to v. This 




implies (Lemma 2^) that there exists a constant c E M such that 

dtMt, 1) < c < </o(t, 1) for a.e. t € [a, b], 
where and denote the left and right derivatives with respect to v. 
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These inequalities, together with ( |1.2|) , (|1.3|), and (1^), are used to obtain a bound on 
the Lipschitz constant of y (Theorem |2.1[) , which is locally uniform (with respect to the 
data of the problem) if L is locally bounded (Theorem 2.2). 

In Section ^ we obtain some extensions of the DuBois-Reymond necessary condition. 
When L(x, •) is not convex this condition is not always satisfied, and we propose some 
additional assumptions on L, which hold true, for instance, when L(x, •) is semiconvex or 
differentiable. Under these assumptions we show (Theorems p.2| and |3.6D that, if y is a 
minimizer, then there exists a constant c £ R such that 

c G Liy{t),y'{t)) - (d' L{y{t),y' {t)),y' (t)) for a.e. t G [a, b], 

where d~L{y{t),y'{t)) is the subdifferential of L{y{t), •) at y'{t). More general results of 
this kind (Lemma |3.1| and Theorem 3.1C| ) are obtained with different generalized gradients 
of L. 

Finally, in Section ^ we apply the Lipschitz regularity of minimizers to study the value 
function of the Bolza problem: 



(L8) V{t,x):=mi{ I L{y{s),y'{s))ds + ip{y{t)) \ y € W^'\0,t; R''), y{0) = x 



where ip:M^ — > U {+cxd}, ip ^ +00, and L is locally bounded, not necessarily convex 
with respect to the second variable. 

Let 1?* := {t G 12 I t > 0} and let H be the Hamiltonian associated with L, defined 

by 

(1.9) H{x,p) := sup {{p,u) - L{x,u)) , 

i.e., H{x, •) is the Legendre-Fenchel transform of L(x, ■). 

Assuming that for all {t, x) G J?* x l?" the infimum in ( |1.8| ) is attained, we prove that 
V is locally Lipschitz on x 12" (Theorem iA) and solves the Hamilton- Jacobi equation 

(1.10) Vt + H{x,-V,) = 



in a generalized sense (Theorem 4.8). When ip is lower semicontinuous, we also provide a 
comparison result for lower semicontinuous subsolutions of ( |1.10 ), which characterizes the 
value function as the maximal lower semicontinuous subsolution of ( |1.1C| ) (Theorem 4.9). 

We conclude the paper with two results (Theorems 4.12 and [4.131) which show the 
relationships between minimizers of (|1.8[) and contingent derivatives of the value function. 
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2 Lipschitz Regularity of Minimizers 



Let L: 1?" x 1?" — > 1?+ be a Borel function, let [a, b] be a bounded closed interval in M, 
and let y G W^'^{a, b; R^) be a function such that 



(2.1) 



pb rb 

/ L{y{t),y'{t))dt < inf / L{z{t), z' {t))dt < +oo, 



where ^(y) := {z € ^^'^(a, 6; R") \ z{a) = y{a), z{b) = y{b)}. 

The main results of this section are the following two theorems. 

Theorem 2.1 Let L: R^ x 12" 1?+ be a Borel function which satisfies ^L^), ([77^, 
(1-4), o-n-d let y G W^'^{a,b; R^) be a function which satisfies (2A). Then y is Lipschitz 
continuous. 

When L is locally bounded on R"' x R^, we obtain a uniform estimate of the Lipschitz 
constant of every minimizer. 



Theorem 2.2 Let 0:1?" — > R^ be a function satisfying ( fi.^ j, let ^:1?+ R^ be a 
nondecreasing function, and let A, B, a, fi > 0. Then there exists a constant K = 
K{Q, A, B, a, f3) with the following property: if L: l?" x 1?" R^ is any Borel function 
satisfying ( \L3i ) and 

(2.2) yR>0, sup L{x,u) <'^{R), 

\x\<R, \u\<R 

and y G W^'^{a,b; R^) satisfies and 



(2.3) mi \y{t)\<A, 

a<t<b 

(2.4) f L{y{t),y'{t))dt<B, 

J a 

(2.5) a<b-a<P, 

then y is Lipschitz continuous with Lipschitz constant bounded by K . 



To prove Theorems 2.1 and |2.2| we need some technical lemmas. 

Let us fix a function y G W^'^{a,b] R^) which satisfies ( |2.1[ ). As in Q we use the 
auxiliary function /: [a, 6] x 12 — > [0, +00] defined by (p!T7|), which turns out to be Ci x Bi- 
measurable, where Ci and Bi denote the u-algebras of Lebesgue measurable subsets of 
[a, b\ and of Borel subsets of R, respectively. From ( p..7[ ) and (2J.) it follows that 



(2.6) 



.6 

/ f{t,l)dt < +00. 

J a 
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The following lemma is well known (see, e.g., ||8|, p. 46]). We write the proof only to 



give a self-contained presentation of the arguments used to obtain Theorems 2A and 

Lemma 2.3 We have ^ ^ 

(2.7) / f{t,l)dt< f f{t,4^'{t))dt 

J a J a 

for every tp € W^'^{a, b) such that ip{a) = a and ip{b) = b. 

Proof — Let us fix ^0 G W^'^{a, b), with 'ip{a) = a and ip{b) = b, such that the right hand 
side of is finite. Then il)'{t) > i for almost all t G [a,b]. Thus ip is increasing and 
|0(t) — ipis)] > ^\t — s\ for all s,t ^ [a, b]. Therefore the inverse function -0"^: [a, b] — > [a, b] 
is Lipschitz continuous with Lipschitz constant 2. These properties imply that 

(2.8) NeCi, \N\ = ^ i){N) £ Ci, \tp{N)\=0, 

where | • | denotes the Lebesgue measure, and that z: = yo belongs to W^'^{a, b; R^) 
and satisfies z{a) = y{a) and z{b) = y{b). Using ( |2.8|) and the chain rule one proves easily 
that z'{t) = y'(V'~^(t))/V''(V'~^(i)) for a.e. t G [a, 6]. Thus, after the change of variables 
s = ip~^{t), one gets 

' L{z{t), z'{t))dt = I' L{y{s),y'{s)/i,'{s)),l,'{s)ds, 



which, together with (|2T|) and (1L7|), yields (|2j). □ 



If g: M ^ [0, +oo] is an arbitrary function, its lower semicontinuous convex envelope 
c6g:M ^ [0, +oo] is, by definition, the greatest lower semicontinuous convex function 
which is less than or equal to g. It is well known that the epigraph of cog is the closed 
convex hull of the epigraph of g, and that, if cog is finite in a neighborhood of some point 
f G -R, then 

(2.9) cx5g{v) = inf {Xg{vi) + (1 - X)g{v2) \ (A, vi,V2) G A{v)} , 

where A{v) is the set of all triples {X,vi,V2) G with < A < 1, g{vi) < +oo, g{v2) < 
+00, and v = Xvi + (1 — X)v2- 

Let us return to the function / defined in (1.7), and let /o = co„/ be its lower semi- 



continuous convex envelope with respect to v. We observe that for every t G [a,b], the 
function v i— > fo{t,v) is continuous on (i,-|-oo), since it is convex and finite on this set. 

Let us prove that for every v G (|,+(X)) the function t i— > fo{t,v) is Lebesgue mea- 
surable. Given 7 G 1?, by ( ^.91) the set {t G [a,b] \ fo{t,v) < 7} is the projection onto 
[a,b] of the set of all points {t, X,vi,V2) G [a,b] x (0,1) x {^,+00) x (i,+oo) such that 
V = Xvi + (1 — X)v2 and A/(t, vi) + (1 — A)/(t, V2) < 7. As this set belongs to the u-algebra 
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Ci X Bi X Bi X Bi, from the projection theorem (see, e.g., [Q, Theorem 8.3.2]) we conclude 
that {t G [a,b] \ fo{t,v) < 7} is Lebesgue measurable. This proves that t fo{t,v) is 
Lebesgue measurable, and hence /o is a Caratheodory function on [a,b] x (i,+oo). 

The following lemma is usually proved when / is continuous in v, or satisfies some 
growth condition. We give here a detailed proof to show that we do not need any additional 
hypothesis. 

Lemma 2.4 We have 

(2.10) r fo{t, i)dt < r /(t, i)dt < [' hit, ip{t))dt 



for every ip G L^{a-, h) with 
(2.11) / ^{t)dt 



In particular, 

(2.12) /(t,l) = /o(t,l) for a.e.te[a,h]- 

Proof — The first inequality in ( 2.10| ) follows from the fact that /o(t, 1) < f{t,l) for 
every t G [a,b]. To prove the second inequality we argue by contradiction. Assume that 
there exists tp G L^{a,b), satisfying ( 2.11 ), such that 

(2.13) [' fo{t,ip{t))dt< [' f{t,l)dt. 

J a J a 

As fo{t,v) = +00 for v < i, from ( |2.6| ) and ( p. 13 ) we obtain that ip{t) > ^ for a.e. 
t G [a,b]. Changing, if needed, 99 on a set of measure zero, we may assume that this 
inequality is satisfied for every t G [a, b]. If we replace ip{t) by ^ip{t) + ^, we obtain a new 
function, still denoted by ip{t), which continues to fulfill ( p. 11 ) and (|2.13| ) (by convexity), 
and, in addition, satisfies the improved inequality (p{t) > | for every t G [a,b]. As /o is a 
Caratheodory function on [a,b] x (i,+oo), the function t 1— > fo{t,(p(t)) is measurable. 
Let us fix e > such that 

(2.14) [\fo{t,v>it))+e]dt < f f{t,l)dt. 

For every t G [a, 6] we define ^^(t) as the set of all triples (A, f 1,^2) G such that 
< A < 1, > ^, 1^2 > ^, Xvi + (1 — A)?;2 = ip{t), and 

A/(t, ^;i) + (1 - A)/(t, V2) < fo{t, vit)) + e. 

By (|2.9|) this set is nonempty for every t G [a, b]. 
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From the measurability properties of / and t i— > fo{t,ip{t)) we deduce that the graph 
of the set- valued map t ^ ^e{t) belongs to Ci x Bi x Bi x Bi. By the Aumann-von 
Neumann selection theorem (see, e.g., [0, Theorem III. 22]) there exist Lebesgue measurable 
functions ^, (^i,(/J2 on [a,b] such that (^2(i)) G ^e{t) for every t G [a,b]. From 

the definition of (t) and from ( 2.14[ ) we deduce that 

(2.15) yte[a,b], < fi{t) < 1, (^i(t) > i ^2{t) > ^, 

(2.16) yte[a,b], fi{t)^i{t) + {l-fi{t))^2{t)=ip{t), 

(2.17) tw)f{t, Vi{t)) + (1 - A^(t))/(t, ip2mdt < t fit, l)dt. 

J a J a 

For every /c > 2 let 

:= |tG[a,6]|Mi)G(^,^]U[-^"^ 



/fc 'fc + 1- 



As < fj,{t) < 1, the interval [a, b] is the union of the sets E^''\ which are pairwise disjoint. 
As If e L^a,b) and /(•, 1) G L'^{a,b) by (|^, from ( ^lej) and (|1|) we obtain that for 
every k>2 the functions <^j(t) and f{t,ipi{t)) belong to L^{E^^^). 

By the Lyapunov theorem (see, e.g., |^, Theorem 8.6.3 and Proposition 8.6.2]) there 

exist two disjoint measurable sets and E^\ with E^^'^ U E'2'^ = E^^\ such that 



(2.18) I (.) = I ,Mt)^i{t) + (1 - ^^{t))^2{t)]dt, 

2 

(2-19) E [ ,,J{t,^^{t))dt= [ Mt)fit,Mt)) + il-Kt))f{t,Mmdt. 

-, JE^ ' JEW 



1=1 

00 



Let ^1 := IJ El"' and E2 := [j E)^' . By ( |2TlD , ( p^ ), ( pTzD , (|2T|), ( p9| ) we obtain 

k=2 k=2 

(2.20) / ipi{t)dt+ I ip2{t)dt= I ip{t)dt = b-a, 

JEi Je2 Ja 

(2.21) / f{t,Mt))dt+ [ f{t,ip2{t))dt< t f{t,l)dt. 

J El JE2 Ja 

Let ifs G L}{a,b) be the function defined by (^3 := ^pi on Si and ip^ := (/32 on E2, and let 
be the primitive of with V'(o) = a- By ( 2.20| ) we have also V'(^) = ^) while ( 2.21| ) 
gives 

' f{t,ilj'{t))dt< [ f{t,l)dt, 
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which contradicts ( |2.7] ) and concludes the proof of ( p.lOD . 

As /o < / and /(•, 1) G L^{a, h) by Q, if we take = 1 in ( ^) we get ( ^l2|) . □ 

Remark 2.5 Ks v ^ foit, v) is convex and finite, for every t € [a, b] there exist the hmits 



(2.22) 
(2.23) 



difoit,!) := hm 



</o(t, 1) 



lim 



Ut,v)- Ut,i) 

V - 1 

/o(t,^)-/o(t,l) 
v-1 



sup 

D<1 

= inf 

D>1 



/o(t,^)-/o(t,l) 

v-1 
fo{t,v)-fo{t,l) 

v-l 



and we have — oo < d^/o(t, 1) < (i^/o(t, 1) < +oo. 



For the sake of completeness, we give now a new elementary proof of a particular case 
of Theorem 3.1 of Q. 

Lemma 2.6 There exists a constant c & R such that 

(2.24) diUt, 1) < c < difoit, 1) for a.e. te [a, b]. 



Proof — We argue by contradiction. If ( 2.24 ) does not hold, then there exists a £ R 
such that 

esssup(i^/o(t, 1) > a > ess inf d^fo{t, 1). 



t£[a,b] 



te[a,b] 



Then the sets 

Ai := [t G [a, b] \ dlfo{t, 1) > a} & A := {t G [a, 6] | </o(t, 1) < a} 
are disjoint and have positive measure. By ( ^.221) for every t G Ai the set 
E^(t) := |v e (-, 1) I __ > a 

is nonempty. Since the graph of the set-valued map t Ei{t) belongs to Ci x Bi, by 
the Aumann-von Neumann selection theorem (see, e.g., ||7|, Theorem III. 22]) there exists 
a measurable function Sf. Ai — > (0, ^) such that 

(2.25) VtG^i, Ut,l-5i{t))- Ut,l) <-a5i{t). 

Similarly, using ( p. 230 we can prove that there exists a measurable function 6r'- A,- (0, ^) 
such that 

(2.26) yt€Ar, Mt,l + Sr{t))- Mt,l) <a6r{t). 
Let us define 



(2.27) 



Q : = 



6i{t)dt 



Sz Cr 



1 -1 



5r{t)dt 



and let if{t) := —ci5i{t) for t £ Ai, (p{t) = Cr5r{t) for t G A^, and ip{t) = otherwise. 
Then by ( ^.271) we have tp{t)dt = 0, and, by (|2.1C| ), for every e > this imphes 

f\ut,l + ev{t)) - Ut,l)] dt>0, 

J a 

which is equivalent to 

(2.28) / [Ut,l-scMt))- foit,l)]dt+ [ [Ut,l + ecr5r{t))- foit,l)]dt>0. 

J A, J Ar 



By the monotonicity property of the difference quotient of a convex function, using ( 2.25| ) 
we obtain for eci < 1 

(2.29) /o(t, 1 - ecMt)) - /o(t, 1) < eq [/o(t, 1 - 5iit)) - /o(t, 1)] < -aecMt) 
for every t £ Ai. Similarly, for ecr < 1 we obtain, using ( p.26| ), 

(2.30) fo{t, 1 + ecr6rit)) - /o(t, 1) < ecr [foit, 1 + 6r{t)) - /o(t, 1)] < aecrdrit) 
for every t £ Ar. From (|2^ )-(^3o|) it follows that 

< —aeci / 5i{t)dt + aecr / 5r{t)dt = 0. 

J Al J Ar 



This contradiction proves 

(HI)- ° 



Proof of Theorem |2.1| — By ( p. 231 ) and ( |2.24| ) there exists a constant c £ R such 
that for a.e. t £ [a, b] and every e £ (0, 1) we have 

,<,„7„(<,,)<AM^£lzA(M), 

hence (1 — e)c < fo{t, 2 — e) — /o(t, 1), which implies 

(2.31) (1 - e)c + e/o(t, 1) < /o(t, 2 - e) - (1 - e)fo{t, 1). 
By convexity we have 

(2.32) Ut, 2-e)< efoit, 1/e) + (1 - e)/o(t, 1), 
so that we obtain from ( p.3lD and ( p. 321 ) 

(2.33) (1 - e)c + efoit, 1) < efo{t, 1/e) < ef{t, 1/e). 
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By ( |1.3D and ( |1.7| ) for every f > we have 

(2.34) fit, v) > L{y{t),y'{t)/v)v > e{y\t)/v)v > coe{y'{t)/v)v, 

where co0 is the lower semicontinuous convex envelope of 0, which still satisfies ( |1.2| 
Since the function v i-^ coQ{y'{t)/v)v is convex for v > 0, from (p.34 ) we deduce that 



(2.35) Vv>0, foit,v) >coe{y'{t)/v)v. 
From (13), (|!3|), and (|2!35|) we obtain 

(2.36) (1 - e)c + SCO G(y'(t)) < L{y{t), ey\t)) 
for a.e. t G [a, 5] and every e G (0, 1). 



Let us now fix t S [a, 6] such that (2.36) holds and \y'{t)\ > 2. For i/ G (0,1] let 
e{t) = ^ < 1. By (|j|) we have 



(2.37) 



, , coe(y'(t)) , / , , y'(t) 
min{c, 0} + , < L y(t), ^ 



|y'(t)l - V^^^' \y'{t)\. 

Since y G W^'^{a, b; 12"), there exists R> such that 

(2.38) Vt G [a, 6], |y(t)[ < i?. 
Since B{0,R) is compact, from ( [1.4| ) we know that 

(2.39) 3 M > 0, 3 r G (0, 1], VuG-B(0,r), L{y{t),u)<M. 
Choosing i/ = r, from (^^) , (|2^ , and (|2!3g| ) we get 



(2.40) 



min{c,0} + r^^^#ll<M. 

|y (*)l 



Since co0 satisfies (1^), by ( p. 401) there exists a constant C = C{Q,c,r, M) > 2, depend- 
ing only on co 0, c, r, and M, such that for a.e. t G [a, b] with |y'(t)| > 2 we have 

(2.41) \y'it)\ < C. 

As C > 2, inequality ( ^A\\ ) holds also when \y'{t)\ < 2. □ 

By Lemma there exists c such that 



Proof of Theorem |2.2 

(2.42) 



</o(t, 1) < c < </o(t, 1) for a.e. t G [a, 6]. 
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By (|L§ and (|2J) we have 
(2.43) 

which, by (|1.2| ), gives 



e{y'it))dt < B, 



\y'{t)\dt < Ml, 



for a constant Mi = Mi{Q,B,(i) > 0. This inequahty, together with (|2.3D, yields \y{t)\ < 
R for every t € [a, b], with R = i?(e, ^, 5, /3) = ^ + Mi. 

We next provide an estimate of c from below. From ( 2.43| ) and (2.5) it follows that 



(2.44) 



a essinf e(y'(t)) < / Q{y'{t))dt < B. 



By (|1.2[ ) there exists M2 = M2(G, a, B) such that for a set Oj, C [a, h] of positive measure 

\y'{t)\<M2. 



(2.45) 

This implies that 
(2.46) 

Since by ( p2D 



VtGJ7j„ L(2/(t),|y'(t)) < ^(i? + 2M2). 



c > sup 

D<1 



Ut,v)-ut,i) 

v-l 



and since /o(t, 1) > for almost all t € [a, 6], we get, setting w = |, 

(2.47) c > -4/(t, f ) = -3L(y(0, |y'(t)) > -3^'(i? + 2M2). 

We now return to the last part of the proof of Theorem with v = r = 1 and 
M = '^{R + 1). As the constant C which appears in (|2.41| ) depends on c in a decreasing 
way, and c > -3^(i? + 2M2), it is enough to set K = C(G, -3'I'(/? + 2M2), 1, ^{R + 1)). 
□ 



3 DuBois-Reymond Necessary Conditions 

Let L:R^ x 1?" M+ be a Borel function, let y G VK^'^(a, 6; 1?") be a function which 
satisfies (2J.), and let g: [a, 6] x 1? — > [0, +oo\ be the function defined by 

(3.1) ,(M):=|^(^(*)'^^'(^)) if0<.<2, 

^ ' »v ; / otherwise. 
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By ( |1.7D we have f{t,v) = g{t, for every u / 0. Let := co^g be the lower semi- 
continuous convex envelope of g with respect to v. As the functions v i— > fQ{t,v) and 
V I— go{t, are lower semicontinuous and convex for w > 0, we deduce that 

\/te[a,b], v>0, foit, v) = go (t, 1/v) v. 

Therefore we obtain from (|2.12| ) 

(3.2) go{t,l)=g{t,l)=L{y{t),y'{t)) for a.e. t G [a, 6]. 

Furthermore t go{t,v) is measurable. To prove this fact it is enough to adapt the 
arguments used for /o in the proof of Lemma 2.2. 



Let us define dlgQ{t, 1) and dygQ{t,l) as in (12^ ) and (^) . It is easy to prove that 
4fo{t, 1) = go{t, 1) - <(7o(t, 1) & </o(i, 1) = go{t, 1) - digoit, 1). 
Therefore, by ( p. 24] ) there exists a constant c G R such that 

(3.3) digo{t,l) <L{y{t),y'{t))-c<d:;go{t,l) for a.e. t G [a, 6]. 

Notice that if u i— L{y{t),u) is differentiable at y'{t), with gradient VuL{y{t),y'{t)), 
then by ( |3.1| ) the function v ^ g{t, v) has a derivative at v = 1 which is equal to 
(V„L(y(t),y'(t)),y'(t)). By (P) this implies 

(3.4) digoit, 1) = <go(t, 1) = (V„L(y(t), y'(t)), y'(t)) , 

and from (|3.3[) and ( |3.4| ) we obtain the DuBois-Reymond necessary condition 

L{y{t),y'{t)) - {VuL{y{t),y'{t)),y'{t)) = c for a.e. t G [a,b]. 

Our aim is to derive similar results when L(y{t), ■) is not differentiable. All our exten- 
sions of the DuBois-Reymond necessary condition (Theorems 3.2, 3.6, and 3.10| ) are based 
on the following lemma. 

Lemma 3.1 Let L:W x ^ R+ he a Borel function, let y G W^'^{a,h-K'^) he a 
function which satisfies {2A), and let tp: [a, 6] x J?" R he a Caratheodory function, with 
^ I— > '0(^) convex and positively homogeneous of degree one, such that for a.e. t G [a, b] 

(3.5) -dlgo{t,l) <i^{t,-y'{t)) & d^goit,!) < ^{t,y'{t)). 

Then there exist a constant c & R and a measurable function p: [a, b] R^ such that for 
a.e. t € [a, b] 

(3.6) p{t) e d^ib(t,o), 

(3.7) L{y{t),y'{t))-{p{t),y'{t))=c, 

where d^'ip{t, 0) denotes the suhdifferential of the convex function 'ip{t, ■) at 0. 
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Proof — 



Since tp{t,-) is convex and positively homogeneous of degree one, 



(3.8) V^Gl?", max {q,0=Ht,0- 



By (3.3) and ( |3.5| ) there exists a constant c such that for a.e. t € [a, b] 

-ij{t, -y'{y)) < L{y{t),y'{t)) - c < i^it, y'{t)), 



so that (3.8) imphes 

mm {q,y'it)) < Liy{t),y'it)) - c < max (g,2/'(t)). 

Let us fix t G [a, b] such that these inequahties are satisfied. The set d^%l){t, 0) being convex, 
we deduce that for some q £ d^ip{t,0) we have {q,y'{t)) = L{y{t),y' {t)) — c. For every 
t G [a, b] let 

(3.9) B{t) := {q G d^iP{t, 0) | {q, y'{t)) = L{y{t),y' {t)) - c] . 

By the previous argument B{t) ^ for a.e. t G [a, 6]. The graph of the set-valued map 
B{t) is the intersection of the sets Bi and B2 defined by 

Bi := {{t, q) G [a, 6] x 1?" | {q, y'{t)) = L{y{t),y'{t)) - c} , 
B2 ■={{t,q) G [a,b]xR^\y^eR^, {q,0 < i'{t,0} ■ 

Clearly Bi and B2 belong to £1 x Bn, where Bn denotes the c-algebra of all Borel subsets 
of Ji". This implies that the graph of the set-valued map t B{t) defined by ( p.9| ) belongs 
to £1 X Bn, and by the Aumann-von Neumann selection theorem (see |0, Theorem III. 22]), 
there exists a measurable function p: [a,b] — > 1?" such that p{t) G B{t) for a.e. t G [a, 6]. 
Then (U) and follow from (|]|). □ 



Let Lq := cOuL be the lower semicontinuous convex envelope of L with respect to u. 
Then {t,u) 1-^ LQ{y{t),u) is a Caratheodory function. This can be verified as in the case 
of /o (proof of Lemma |2.3D , taking convex combinations of n -|- 1 vectors. 



Theorem 3.2 Let L: x 1?" ^ be a Borel function and let y G W'-'^ia, b; 1?") be a 
function which satisfies {2A). Suppose that for a.e. t G [a, 5] 

(3.10) L{y{t),y'{t)) = Lo{y{t),y'{t)), 

(3.11) -dig^it, 1) < dMy{t),y'{t)){-y'{t)), 

(3.12) d;5o(t, 1) < duLQ{y{t),y'{t)){y'{t)), 
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where duLQ{x, u)(S^) denotes the directional derivative of the convex function Lq{x, •) at u in 
the direction ^. Then there exist a constant c (z M and a measurable function p: [a, b] — > 
such that a.e. t E [a,b] 

(3.13) p{t)£duLo{y{t),y'{t)), 

(3.14) Lo{y(t),y'{t))-{p{t),y'{t))=c. 

Consequently, 

(3.15) {p{t),y'{t)) - L{y{t),y'(t)) = sup {{p{t),u) - L{y{t),u)) = -c 
for a.e. t € [a, b]. 



Remark 3.3 Since go{t,v) > LQ{y{t),vy'{t)) for a.e. t E [a,b] and for every v & R, ii 
( CT ) holds, then by Q 

-d%{t, 1) > dMyit),y'{t))i-y'{t)) & <(7o(t, 1) > duLo{y{t),y'{t)){y'{t)), 

so that ( |3.11D and ( p. 121 ) are actuahy equaUties. Assumptions ( |3.10D - p.l2D are satisfied, 
for instance, go{t,v) = LQ{y{t),vy' (t)) for a.e. t G [a, 6] and every v G R. 



Remark 3.4 If H is the Hamiltonian associated to L, defined in (^), then, by ( 3.15| ), 



H{y{t),p{t)) = —c for almost all t G [a,b]. The function p corresponds to the co-state 
of optimal control theory. In other words, we proved that the Hamiltonian is constant 
along the optimal trajectory/co-state pair {y,p). In the case of smooth Hamiltonians 
this is indeed a well known property of optimal trajectories of autonomous Bolza control 
problems. 



Proof of Theorem |3.2| — The result follows from Lemma |3.1| , taking ^(t,^) := 
(iuLo(?/(t), y'(t))(0- Indeed, the convexity of LQ{y{t),-) implies that tpi^,-) is convex and 
9gV(i,0) = duLo{y{t),y'{t)) for a.e. t G [a,b]. Equality ( ^Isj) follows from ( |3l0| ), (|3l^ ), 
and ( |3l^ ). □ 

To state further extensions of the DuBois-Reymond necessary condition, we need to 
recall several notions of generalized derivatives. Let ip: R^ — > J? U {-|-cxd}. The subdiffer- 
ential of at x G dom((^) is defined by 

(3.16) d-^{x) := L G R- I > 

L \y — x\ 
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An equivalent definition of subdifFerential uses the lower contingent derivatives of defined 
by 

(3.17) VuGl?-, I?,^(.)(n):=liminf^^:^±M^^. 
Then, 

(3.18) ped-ip{x) VfGli", {p,v) <D^^ip{x){v). 
(see, e.g., [Q|). The upper contingent derivative of 99 at x is defined by 

The superdifferential d^ip{x) of 99 at 2; is defined by d~^(p{x) := —d~{—ip){x) or, equiva- 
lently, by 

(3.19) ped+ip{x) VfGli", {p,v) > D^ip{x){v). 
We use also the lower Dini directional derivative, defined by 

(3.20) yueK^, d-^(x)(u) := hminf '^^^ ^ ^""^ ~ '^^^^ . 



Let us return to the Lagrangian L considered at the beginning of this section. Partial 
derivatives and partial differentials of L with respect to u are defined in the usual way: 
given X G 1?", we consider the function (/?(•) := L(x, •), and set D-^uL^x^u) := D^ip{u), 
d~L{x,u) := d~ip{u), D|„L(x,m) := D^if{u), d^L{x,u) := d'^ip{u), and d~L{x,u) := 
d~(p{u). 

Remark 3.5 By (|3.l| ) and ( ^.2| ) for a.e. t G [a, b] and every v G (0, 2) we have 

go{t,v)<g{t,v)=L{y{t),vy'{t)) & <7o(t, 1) = 5(t, 1) = ^(^(t), y'(i)), 
which implies 

(3.21) -digo{t,l)<dZL{y{t),y'{t)){-y'{t)) & d^goit,!) < d~L{y{t),y'{t)){y'{t)). 
Therefore the conclusions of Lemma continue to hold if ( |3.5| ) is replaced by 

(3.22) d-L{y{t),y'{t)){±y'{t)) < i;{t, ±y'{t)) 
for a.e. t G [a, b]. 
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For every {x,u) G 1?" x 1?" let ^ i— > co D|„L(x, be the lower semicontinuous 

convex envelope of the function ^ D|„L(x, n)(,^). 

Theorem 3.6 Let L: R" x J?" ^ R+ be a Borel function and let y G W^^^{a, b; R"-) be a 
function which satisfies ( |^. Suppose that for a.e. t £ [a,b] 

(3.23) -di,goit, 1) < co D^My{t),y'it)){-y'{t)), 

(3.24) d,^5o(i,l) <coZ)t„L(y(t),y'(t))(y'(t)), 

(3.25) Veeli", WD^^L{y{t),y'{t)meR. 

Then there exist a constant c £ R and a measurable function p: [a, b] 1?" such that 

(3.26) p{t) G a-L(y(t),y'(t)) for a.e. t G [a, 6], 

(3.27) L(y(t),y'(t))-(p(t),y'(t))=c /or a.e. t G [a, 6]. 



Remark 3.7 By (|3^ ) inequalities (|3^ ) and (|^) are satisfied if 



d-L{y{t), y'{t)){±y'{t)) < co D^^L{y{t),y' {t)){±y' (t)), 



for a.e. t G [a, 6]. This shows that ( ^.23D -( ^.25 ) are always satisfied if L{y{t), •) is differen- 
tiable at y'{t). 

Remark 3.8 We recall that a function (/?: R^ R is called semiconvex if there exists 
Lv: R^ X R_|_ R^, satisfying 

V r < i?, V s < 5, uj{r, s) < uj{R, S) k lim uj{R, s) = 0, 

such that for every > 0, A G [0, 1], and all x, y G B{0, R) 

ip{Xx + (1 - X)y) < Xip{x) + (1 - X)ip{y) + A(l - A)|x - y\ uj{R, \x - y\). 

Observe that every convex function is semiconvex (with oj equal to zero). Furthermore, if 
(p: R^ — > R is continuously differentiable, then it is semiconvex. Using standard arguments 
of convex analysis (see, e.g., p. 25]) one can prove that every semiconvex function ip is 
locally Lipschitz. Furthermore, for every v G R^ 

D^ip{x){v) = hm , 

and the function v ^ D^ip{x){v) is convex (see, e.g., |6|, Theorem 3.9]). These facts, 
together with Remark p.7| , show that assumptions ( 3.23| )-( |3.25 ) of Theorem p. 6| are always 
satisfied when L(x, •) is semiconvex. 
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Proof of Theorem |3.6| — Let us define ip{t,£,) := co Z)^„L(y(f), Using the 
projection theorem it is possible to check the measurabihty with respect to t. Notice 
that ^^^p{t,0) C d' L{y{t),y'{t)) for a.e. t G [a,b]. Indeed, if g G ^^^p{t,0), then (g,^) < 
iP{t,^) < D^uL{y{t),y'{t)m for every ^ G R", hence q € d- L{y{t),y'{t)) by §JBi). The 
conclusion follows then from Lemma 3.1. □ 



Remark 3.9 Theorem 3.2 has stronger assumptions and stronger conclusions than The- 
orem ^]6|. Indeed, as L > Lq, it follows from (|3.1C| ) that 

(3.28) dMy{t),y'{t))iO = i?t«^o(y(t), y'(t))(0 < D^^L{y{t),y'{tm) 

for every ^ € 12". Since ^ i-^ duLo{y{t),y'{t)){(,) is convex, we conclude that 

duLo{y{t),y'{t)){±y'{t)) < cx5 D^^L{y{t), y' {t)){±y' {t)). 
This shows that imply (l33^)-(|33^). 



On the other han d, plHD an d (||2|) yield d-Lo{y{t),y'{t)) C L{y{t),y' (t)) for a.e. 
t E [a,b]. Therefore (|3.iq), (p.lSP, and (|37l4|) imply (|33^ and (|]2^). 



Theorem 3.10 Let L:R^ x ^ R+ be a Borel function and let y E W^^^{a,b;R^) 



be a function which satisfies (2.1). Suppose that L{x,-) is locally Lipschitz continuous for 
every x E -R"". Then there exist a constant c R and a measurable function p: [a, b] — > 
such that for a.e. t E [a, b] 

(3.29) p{t) eduL{y{t),y'{t)), 

(3.30) L{y{t),y'{t))-{p{t),y'{t)) = c, 

where duL{x,u) denotes the Clarke generalized gradient of L{x,-) at u. 
Proof — Let us define 

^(U) = limsup^M^^i±M^^M^. 

It is known that ip{t,-) is convex and that ^^^l^{t,0) is the Clarke generalized gradient 
of L(y{t),-) at y'{t) (see [^). Since d~L{y{t)^y'{t)){^) < -0(^,0) the result follows from 
Lemma h.ll and Remark p^. □ . 



Replacing sub differential by superdifferential we get another extension of the DuBois- 
Reymond necessary condition, which is meaningful only at those points t E [a, b] for which 
d+L{y{t),y'{t))^0. 
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Proposition 3.11 Let L: x ^ be a Borel function and let y e VF^'^(a, 6; -R") 
he a function which satisfies There exists a constant c ^ R such that 

Vp E dtL{y{t),y'{t)), L{y{t),y' (t)) - {p,y'{t)) = c 

for a.e. t G [a, b]. 

Proof — From we have 

d:;go{t,l) < D!^uL{y{t),y'{t)){y'{t)), 
dlgo{t,l) > -DiuL{y{t),y'{t)){-y'{t)). 

These inequahties and ( |3.3| ) imply that there exists a constant c such that for a.e. t E [a, b] 

-D^uL{y{t),y'{t)){-y'{t)) < L{y{t), y'{t)) - c < D^uL{y{t),y' {t)){y' {t)), 

and we deduce from ( |3.19D that for all p € d^L(y{t),y'{t)) 

{-P, -y'{t)) < L{y{t),y'{t)) -c<{p, y'{t)) , 

ending the proof. □ 

4 Hamilton-Jacobi Inequalities 

Let cf.K^ — > 1?+ U {+00} with ip ^ +00. Given T > and yo E 1?", let us consider the 
Bolza problem: 

L{y{s),y'{s))ds + ^{y{T)) 



mm 

y Jo 

over all absolutely continuous functions y E W^'^{0,T; K^) satisfying the initial condition 
y{0) = yo- The dynamic programming approach associates with this problem the family 
of problems > 0, x E li"): 

min / L{y{s),y'{s))ds + ip{y{t)) 



V Jo 

over all absolutely continuous functions y E W^'^{0,t; R"^) satisfying y(0) = x. The 
corresponding value function V: R^ x 1?" —)■ R^ U {+cx3} is defined by (|1.^). 

Proposition 4.1 Let L: 1?" x 1?" R^ be a Borel function and let ip: 12" 1?+ U {+0x0} 
with if ^ +00. Then V{0,x) = (p{x) for every x E 12". Furthermore, if L satisfies (IIT 



and (LS_), and is lower semicontinuous, then 



(4.1) limmf ^(t,^) > ip{xo) 

for every xq E 12"". 
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Proof — Fix xq G 12" and let ti 0+, Xi — > xq be such that 

limmfV(t,x) = Mm V{ti,Xi). 

If the above Umit is infinite, then our claim follows. If this limit is finite, then we consider 
Vi G W^'^{0,ti;M') such that yi{0) = Xi and 

U I 

L{yi{s),y'i{s))ds + ip{yi{ti)) < V{ti,Xi) + -. 

By (^), since (p > 0, for some M > we have /q' Q{y'^{s))ds < M for every i. Setting 
y'iis) = for s G {ti, 1], we deduce from (L2) that the functions y'^ are equiintegrable and 
therefore the functions j/j are equicontinuous. Since U — > 0+ and yi{0) = Xi xq, we get 
yi{ti) — > Xq. On the other hand, since L > 0, we have (p{yi{ti)) < V{ti,Xi) + i. Taking 
the lower limit and using the lower semicontinuity of if we conclude the proof. □ 

We recall that U* := {t G R \ t > 0} . In this section we often assume the following 
hypotheses: 



(HI) for every {t,x) G 1?^ x the infimum in (L8) is attained, 
(H2) L is locally bounded and satisfies (p. .21) and (1.3). 



It is easy to see that (H2) implies that < V{t, x) < oo for all (t, x) G 
Remark 4.2 If for every t > the functional 

(4.2) 4(2/) ■■= f L{y{s),y'{s))ds 



is sequentially weakly lower semicontinuous on T^^'^(0, t; 1?") and is lower semicontin- 
uous, then from ( [L.2| ) and (1.3) it follows that (HI) is satisfied. Furthermore, arguing as 
in 1 11, Proof of Proposition 3.1], we can show that in this case V is lower semicontinuous 
on R+ X J?". 



Lemma 4.3 Let L: 1?" x 1?" R^ be a Borel function and let ip: R^ 1?+ U {+00} 
with ip ^ +00. Assume that (HI) and (H2) are satisfied. Then, given (to,a;o) ^ -K* x 1?" 
and < 5 < to, there exists r > such that for all {t,x) G B{{tQ,XQ),5) every minimizer 
y{-;t,x) of is r-Lipschitz. 
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Proof — Consider uq € 12", with ip{yo) < +00, and set z{s) = x + |(yo — x). If y{-;t,x) 
is a minimizer of (|1.8|), we obtain 



L{y{s;t,x),y'{s;t,x))ds < ip{yo) +t sup L(z(s), (yo - 

Since L is locally bounded, for every < 6 < Iq there exists a constant > such that 

sup L{z{s), (yo - x)/t) < Ms 
se[o,i] 



for every {t,x) G i?((to, a^o)) The conclusion follows now from Theorem 2.2 



□ 



Theorem 4.4 Let L: R^' x W ^ be a Borel function and let v?: 1?" ^ U {+00} 
with ip ^ +00. Assume that (HI) and (H2) are satisfied. Then V is locally Lipschitz 
on R*^ X R^. If ip is lower semicontinuous on R^ , then V is lower semicontinuous on 



1+ X 



Proof — The Lipschitz continuity is proved in [0, Corollary 3.4]. For the reader's 
convenience we repeat here the proof. 

Fix (io,aJo) G x -K". By Lemma there exist r > and 5 > such that 
for all {t,x) G S((to, a;o), every minimizer y{-;t,x) of ( |1.8D is r-Lipschitz. We may 
assume that 56 < tQ. Let {ti,xi) and {t2,X2) be two distinct points of B{{to, xq), 6), 
let /ii := 1^1 — t2\ + |xi — X2I, and si := hi — ti + t2- Let ui G R^ be such that 
y(si; ^2, 2:2) = xi + hiui. Then < /ii < ti, < si < 2/ii, and 

(4.3) \m\ < \y('r^t2 -^) - + l^^-^il < 2r + L 

All All 

Let yi: [0, ti] 1— > J?" be the function defined by 

xi + sui if < s < /ii, 

y(s - ti + t2; ^2,2:2) if /ii < s < ti. 



yi(s) 



Then 



^(ti,xi) < r L{yi{s),y[{s))ds + ^{yi{ti)) 



/ L{xi + sui,ui)ds + Liy{s;t2,X2),y'is;t2,X2))ds + ip{y{t2;t2,X2)). 

Jo Jsi 



As si = hi — ti + 12 > and L > 0, we obtain 



y{h,xi)< / L{xi + sui,ui)ds + V{t2,X2). 
Jo 
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Since L is locally bounded, it follows from ( ^.31 ) that there exists a constant M, depending 
only on L, to; xq, 6, and r, such that 



V{ti,Xi) -V{t2,X2) <Mhi = M{\ti-t2\ + \xi-X2\). 

Exchanging the roles of {ti, xi) and {t2,X2) we get that V in M-Lipschitz on B{(tQ, xq), 6). 

If Lf is lower semicontinuous, then V is lower semicontinuous at all points of {0} x 
by Proposition iA. The lower semicontinuity on 12* x J?" is a consequence of the local 
Lipschitz continuity. □ 

We recall the definition of the function L^{x, u) used in to study Hamilton- Jacobi 
equation ( |1.10 ) arising from a discontinuous Lagrangian: 

(4.4) L^(x, u) := limsup — inf I / L(y(s),y' (s))ds \ y{—h) = x — hu, y(0) = x\ . 
Similarly we define the function L~{x,u) by 

(4.5) L^{x, u) := liminf — inf < / L{y{s),y'{s))ds \ y{h) = x -|- hu, y{0) = x \ . 

h^o+ h y \ Jo 



Proposition 4.5 Assume that L is locally bounded. If Ufi ^ u as h ^ 0+, then 

(4.6) L+(x,ii) = lim sup i inf ( / L{y{s),y' {s))ds \ y{-h) = x - huh, y{0) = x\ , 

h^o+ h y [J-h J 

(4.7) L^(x, u) = liminf — inf < / L(y(s),y' (s))ds \ y(h) = x + huh, y(0) = x\ . 

h^o+ h y \^Jo J 

Proof — The following proof is a slight modification of the proof of pT| , Proposition 3.6] . 
Let us fix {x, u) and u^ as in the statement of the proposition, and let L{x, u) be the right 
hand side of ( |4.6| ). We want to show that L{x,u) < L'^(x,u). For every /i > let 
£h = \uh — u\ and let be such that yh{—{l — £h)h) = x — (1 — £h)hu, yh{0) = x, and 



L{yh{s),y'h{s))ds -h^ < 

-(l-eh)h 

< inf I /° L{y{s),y'{s))ds : y(-(l - eh)h) = x - {1 - £h)hu, 2/(0) = x\ . 

y \J-{l-eu)h J 

We extend yn on the interval [— /i, —(1 — eh)h] by the affine function satisfying yh{—h) = 
X — huh and yh{—{l — eh)h) = x — {1 — £h)hu. Since on this interval the derivative of y^ is 
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equal to (u/j — (1 — eh)u)/£h, which is uniformly bounded, we deduce that for some M > 
and all h > 0, 

/ L{yh{s),yh{s))ds < L{yh{s),yh{s))ds + Mds. 

J-h J-{l-£h)h J-h 

Dividing by h and taking the upper limit when h —* 0+ we get L{x,u) < L^{x,u). The 
opposite inequality can be proved in the same way. The proof of ( [4.7D is similar. □ 

Remark 4.6 From the previous proposition it follows that, if hi 0+, Ui — > u, and 

Hi G VF^'-'^(0, hi) satisfies yi{0) = x and y{hi) = x + hiUi, then 

(4.8) L-{x,u) < liminf-3- (^^ L{yi{s),y[{s))ds. 

i-*oo tli Jo 



Proposition 4.7 Assume that L is locally bounded. For every y G VF^'"'^(0, t; K") we have 
L+{y{s),y'{s)) < L{y{s),y'{s)) and L-{yis),y'{s)) < L(y(s), for a.e. s G [0,t]. If 
y is a minimizer of ( \1.^ ), then y'(s)) = y'(s)) = L{y{s),y'{s)) for a.e. 

s G [0,t]. 

Proof — Assume first y G VF^'°°(0, t; K"). Since L is locally bounded, the function 
s 1-^ V('S) := Iq L{y{T),y' {T))dT is absolutely continuous. Let s G [0,t] be such that both 
ip'{s) andy'(s) do exist and'ip'{s) = L{y{s),y' (s)). Since = {y{s)—y{s — h))/h converges 
to y'{s) as /i — > 0+, from Proposition ^]5|we obtain 

L+(y(s),y'(5))< hm ]- T L{y{T),y'{T))dT = i;'{s) = L{y{s),y\s)), 

h^0+ h Js-h 

which concludes the proof of the inequality L~^{y{s),y'{s)) < L{y{s),y' (s)) when y is 
Lipschitz. 

If y G VF^'^(0, i; -R"), we can apply a Lusin type approximation theorem for Sobolev 
functions (see, e.g., ||l^, Theorem 3.10.5]), which asserts that for every e > there exist 
ys G W^'°°{0,t; M"') and an open set such that \U^\ < e and ^^(s) = y{s) for all 
s G [0,t] \ Ue. As y'^{s) = y'{s) for a.e. s G [0,t] \ U^, we obtain that L-^{y{s),y'{s)) < 
L{y{s),y'{s)) and L~{y{s),y'{s)) < L{y{s),y'{s)) for a.e. s G [0,t]\C/£. Since e is arbitrary, 
these inequalities hold for a.e. s G [0,t]. 

If y is a minimizer of (|l. j), then for every s G (0, t) and every h G (0, s) we have 

L{y{T),y'ir))dT = inf | j'^ L{z{t), z'{T))dT \ z{-h)=y{s - h), z(0) = y(s)| . 

(4.9) 
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Let us fix a Lebesgue point s € (0, t) for the function L{y{s),y' (s)) such that {y{s) — 
y{s — h))/h — > y'{s) as h ^ 0+. If we divide both sides of ([4.9D by h, the left hand 
side tends to L{y{s),y' (s)) while the right hand side tends to L~^{y{s),y'{s)) thanks to 
Proposition |4.5| , applied with x := y{s), u := y'{s), anduh ■= {y{s)—y{s—h))/h. Therefore 
L^(y{s),y'{s)) = L{y{s),y'{s)) for a.e. s £ [0,t]. The proof for L~ {y(s),y' (s)) is similar. 
□ 

Let us define 

(4.10) H+{x,p):= sup {{p,u) - L+{x,u)) , 

(4.11) H~{x,p):= sup ({p,u) — {x,u)) . 



Theorem 4.8 Let L: EJ' y. EJ' ^ R+ be a Borel function and let ip: J?" ^ 12+ U {+00} 
with ip ^ +00. Assume that (HI) and (H2) are satisfied. Then the value function V 
satisfies the following two inequalities: 

(4.12) V (t,a;) G 1?* X 1?", 3 n G 1?", D^V{t,x){-l,u) < -L-{x,u), 

(4.13) V (t,j;) G 1?+ X 1?", Vu G li", L>j,y(t, x)(l, -u) < L+(x, u). 

Consequently, V is a supersolution to on x 1?" when H is replaced by H~ , i.e., 

(4.14) V(t,2;) G«; xl?", y {pt,p^) ed-V{t,x), pt + H-{x,-p^)>0, 
and V is a subsolution to ^l-lOj ) on Rj^ x 12" when H is replaced by , i.e., 

(4.15) y{t,x)eR+xR'',y{pt,p^)ed'V{t,x), pt + H+{x,-p.^) <0. 

Proof — Let t > 0, x G 1?", and let y be a minimizer of (|1.^). By Theorem |2.1| y(-) is 
Lipschitz. By minimality for all < /i < t we have 

Vit, x) = Vit - h, y{h)) + r Liy{s), y'is))ds. 

Jo 

Consider hi 0+ such that for some u G R^, Ui := {y{hi) — x)/hi —> u. Then y{hi) = 
X + hiUi, and (0) yields 

1 

I?|y(t, x)(—l, m) <— limsup — / L{y{s),y'{s))ds < —L {x,u), 

i^oo i^i Jo 

which proves ( [4.12| ). 
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Let {pt,p^) G d-V{t,x). Then, by ( |3l8D , 

-Pt + (Px,-"-) < D^V{t,x){-l,u), 
hence pt + {—px,u) — L~{x,u) > 0. By (|4.11| ) this inequahty gives ( 4.14 ) 



To prove inequahty ( 4.13| ), we fix any u G -R" and let hi 
definition of V it fohows that 



0+, Ui 



u. From the 



< inf 

y 



hi 



V{t + hi,x — hiUi) — V{t, x) < 
L{y{s),y\s))ds \ y{-hi) = x- him, y(0) = x 



Then we divide by hi and pass to the upper hmit as i — >• oo. Taking ([4.q ) into account we 
obtain To prove ( p^ ) it is enough to apply plSj ), ( gl^ ), and ( p^ . □ 

Theorem 4.9 iei L: 1?" x 1?" ^ 6e a Borel function, let ip: W ^ R+\J {+00} be 
a lower semicontinuous function with ip ^ +00, and let W: x l?" — > 1? U {+00} 6e a 
lower semicontinuous function which satisfies the initial condition W{0, •) = if. Assume 
that (HI) and (H2) are satisfied. If W is a subsolution of the Hamilton- J acobi equation 
in the sense that 

(4.16) V (t,x) G dom(iy), Vu G J?", DiW{t,x){l,-u) < L+{x,u), 

then W <V on x M". Therefore the value function V is the greatest lower semicon- 
tinuous function W which satisfies inequality (i-lt) and the initial condition W{Q, •) = ^p. 



We shall use the following well known lemma (see, e.g., [|l^. Chapter 5, Section 2, 
Exercise 3]). For completeness we give here an elementary proof. To simplify notation, in 
the case of functions / of one real variable the lower Dini derivative d~ f(t){l), defined by 
( |330| ), is denoted by d'fit). 

Lemma 4.10 Let [a, b] be a bounded closed interval in R and let f: [a, b] ^ ML) {+00} be 
a lower semicontinuous function such that d~ f{t) < for every t G [a, b) with f{t) < +00. 
Thenf{b)<f{a). 

Proof — For every e > let us consider the lower semicontinuous function feit) ■= 
f{t) — et, which satisfies the stronger inequality d~ fir{t) < —e for every t G [a,b) with 
fs{t) < +00. We claim that feib) < /e(a)- If this inequality is not satisfied for some 
e > 0, then the infimum of fs is attained at some t^ G [a,b) and we have fe{te) < +00. 
Since d~ f grits) < —e, there exists s^ G {te,b) such that feise) < feite)-, contradicting the 
minimality of t^ and proving our claim. Taking the limit in the inequality /e(6) < /e(a) 
as e ^ 0+ we conclude the proof. □ 



An alternative proof of the following corollary can be found in 
cise 10]. 



Chapter 6, Exer- 
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Corollary 4.11 Let [a, b] be a bounded closed interval in R and let f: [a, b] ^ ML) {+00} 
be a lower semicontinuous function with f{a) < +00. Suppose that there exists a constant 
M e M such that d~f{t) < M for every t G [a,b) with f{t) < +00. Then f{t) < +00 for 
every t £ [a,b]. Suppose, in addition, that for some g E L^{a,b) we have d~f(t) < g{t) 
for a.e. t G [a,b]. Then 



(4.17) 



f{b) - f{a) < / g{t)dt. 



Proof — By Lemma the function /a/ (t) := fit) - Mt is nonincreasine. Therefore 
fit) < fia) + Mit -a) < +00 for every t G [a, b]. If d"/(t) < git) for a.e. t G [a, b], then 
I'm^^) — di^) ~ ^ ^-^^ ^ ^ ^^'^ Lebesgue theorem on derivatives of monotone 

functions yields 



fnib) - fuia) < I f'Mit)dt 

J a 

which implies ( 4.17| ). □ 



< 



igit) - M)dt, 



Proof of Theorem 4.9 



Let us fix t > 0, X G R^, and let y be a minimizer of ( |1.8p . 
It is Lipschitz continuous by Theorem |2.1| . Let us define 7(5) := Ty(s,y(t — s)). Then 
7 is lower semicontinuous on [0, t] and 7(0) = (piyit)) < +00. Let us fix s G [0,t) with 
7(5) < +00. Consider a sequence hi 0+ such that 



d 7(s) 



lim 



(4.18) 
We can write 

(4.19) jis + h,)-jis)=Wis + h^,yit 



jis + hi) -7(5) 



hi 



hiUi) - Wis,yit - s)), 



with Ui := — (y(t — s — hi) — y(t — s))/hi. Passing to a subsequence we may assume that 
Ui converges in M"" to some vector u, whose norm is bounded by the Lipschitz constant of 



y. From ( |4l6D , (|1|), and ( p^D it follows that 

(4.20) d-jis)<L+iyit-s),u). 

Since the function L"*" is locally bounded, we conclude that there exists a constant M such 



that (i~7(s) < M for every s G [0,t) with 7(5) < +00. By Corollary 4.11 this implies that 
7(s) < +00 for every s G [0,t]. 

If the derivative y'it — s) exists, then u 



y'it 



s . 



Therefore ( 4.20 ) gives d 7(5) < 



L^iyit — s),y'it — s)) for a.e. s G [0, t], which, together with Proposition 4.7, yields 



d 7(5) < Liyit — s),y'it — s)) for a.e. s G [0,t]. By Corollary 4.11 we obtain 



lit) < 7(0) + / Liyit - s),y'it - s))ds, 
Jo 
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which is equivalent to 



Wit,x)<^(y{t))+ / Liy{s),y'is))ds. 



Since the right hand side is equal to V{t,x), we have proved that W{t,x) < V{t,x). 
The last assertion of the theorem follows now from Theorems 4.4 and Ely. □ 



We conclude this section with some results which connect the minimizers of (IT 
the contingent derivatives of the value function. 



with 



Theorem 4.12 Let L: W ^ be a Borel function and let ip: J?" ^ 1?+ U {+00} 

with if ^ +00. Assume that (HI) and (H2) are satisfied. If y is a minimizer of ^1-^ ), 
then 

(4.21) D^V{t - s, y{s)){-l, y'{s)) = D^V{t - s, y{s)){-l, y'{s)) = -L{y{s),y'{s)), 

(4.22) D^V{t - s, y{s))il, -y'is)) = D^V{t - s, y{s)){l, -y'{s)) = L{y{s), y'{s)) 

for almost all s € [0,t]. 



Proof — Since V is locally Lipschitz on 1?* x l?" by Theorem 4.4, the function 
7(5) := V{t — s, y{s)) is locally absolutely continuous on [0, t). Fix s € (0, t) such that the 
derivatives 7'(s) and y'{s) exist. Let us prove that 

(4.23) D^V{t - s, y{s)){-l, y'{s)) = D^V{t - s, y{s)){-l, y'{s)) = i{s), 

(4.24) D^V{t - s, y(s))(l, -y'{s)) = D^V{t - s, y{s)){l, -y'{s)) = -^is). 

Let hi —5- 0+ and Ui — > y'{s) such that 

V{t- s- hi, y{s) + hiUi) - V{t - s, y{s)) 



(4.25) D^V{t-s,y{s)){-l,y'{s)) 



lim 

i— ►oo 



hi 



As V is Lipschitz near {t — s,y{s)), there exists a constant M > such that 

(4.26) \V{t - s - hi,y{s + hi)) - V{t - s - hi,y{s) + hiUi)\ < 

< M\y{s + hi) - y{s) - hiy'{s)\ + Mh,\u, - y'{s)\ 

for i large enough. From ( 4.25|) and ( 4.261) we obtain the second equality in ( 4.23 ). The 
other equalities in (4.23) and ( 4.24| ) can be obtained in the same way. 
On the other hand, by minimality, for all small h > we have 

rs+h 

(4.27) V{t-s- h, y{s + h)) = V{t - s, y{s)) - / L(y(r), y'(r))dr. 



Since y is Lipschitz by Theorem |2.1| , the function s 1-^ L{y{s),y'{s)) is bounded. By 
the Lebesgue theorem (4.27) implies that 7'(s) = —L{y{s),y'{s)) for a.e. s £ [0,t]. The 
conclusion follows now from (|4.23| ) and ( ^.24]) . □ 
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Theorem 4.13 Let L: x R" R+ be a Borel function and let ip: R"" R+U {+00} 
be a lower semicontinuous function with ip ^ +00. Assume that (HI) and (H2) are 
satisfied, and let V be the value function given by Define the set-valued maps 

F{t,x) := {u e I D^V{t,x){-l,u) < -L{x,u)}, 
G{t, x) := {u G I DiV{t, x)(l, -u) > L{x, u)}. 

Given t > 0, x G R^, and y G W^'^{0,t; R^) with y(0) = x, the following conditions are 
equivalent: 

(a) y is a minimizer of 

(b) y'{s) G F{t - s,y{s)) for a.e. s G [0,t], 

(c) y'{s) G G{t - s,y{s)) for a.e. s G [0,t]. 

Proof — If y is a minimizer if ([L.8|), then y'{s) G F{t — s, y{s)) and y'{s) G G{t — s, y{s)) 
for a.e. s G (0,t) by (|]2lD and g^H). 

If y solves the differential inclusion y'{s) G F(t — s,y{s)) for a.e. s G [0,t], we define 
7(5) := V{t — s,y{s)). Since V is locally Lipschitz on R^ x 1?", the function 7 is locally 
absolutely continuous on [0, t). Using ( 4.23| ) and the definition of F{t — s, y{s)), we obtain 
that L{y(s),y'{s)) < — 7'(s) for almost all s G [0,t], which implies that L{y{s),y'{s)) is 
integrable on [0, t — e] for every e > 0. By integrating we obtain 

7(t-e)+ /* ' L{y{s),y'{s))ds<j{0). 







As 7(t — e) = V{e, y{t — e)) and 7(0) = V{t, x), taking the lower limit as e — > and using 
Proposition we get 

^{y{t)) + f\{y{s),y'{s))ds < V{t,x). 



Consequently, y is a minimizer of ([L.g|). 

If y solves the differential inclusion y'(s) G G{t — s,y{s)) for a.e. s G [0,i], we repeat 
the same proof, replacing (4.23) with ([4.241). □ 
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